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■ We consider the normal state of a dense ultracold atomic Fermi gas in the presence of a Fesh- 

04 ' bach resonance. We study the BCS and the molecular instabilities and their interplay, within the 

framework of a recent many-body approach. We find surprisingly that, in the temperature domain 
^ ■ where the BCS phase is present, there is a non zero lower bound for the binding energy of molecules 

at rest. This could give an experimental mean to show the existence of the BCS phase without 
observing it directly. 
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. Experimental progress in the study of ultracold Fermi gases has proceeded quite recently at a very fast pace. 
O Working in the vicinity of a Feshbach resonance which allows to cover a very wide range of scattering length by 
, sweeping the magnetic field across the resonance, several groups dealing either with ^'^K [1,2] or ^Li [3-5] have been 
able to vary the interatomic interaction in such a way that the system goes essentially from a weakly attractive 
^l* \ atomic Fermi gas to a dilute gas of diatomic molecules. The clear observation of long lived molecules is one of the 
^ ' very positive outcomes of these experiments. More generally these experiments have shown that it is quite easy to 
c/2 ' shift rapidly the magnetic field and thereby modify the scattering length a, and consequently interactions, in such a 
way that the system does not have time at all to adjust to this change. Hence it is experimentally feasible to prepare 
the gas in an out-of- equilibrium situation, then to study its evolution from a metastable state and in particular the 
S manifestation of various instabilities. 

■ In this paper we study, throughout the a — T phase diagram, the two instabilities which arise in a normal Fermi 
\ gas due to an attractive interaction, namely the molecular and the BCS instabilities. We have just stressed that 
Q ■ this situation is quite relevant experimentally. We find an unexpected interplay between these two instabilities. A 
O particular consequence is that, at temperatures where the BCS phase is present, there is a nonzero threshold for 
the binding energy of molecules at rest. In other words it should not be possible to observe such a molecule with 
I zero binding energy, in contrast to the standard situation for two atoms in vacuum where the binding energy of the 
^ molecule is zero right at the resonance = 0. Hence quite unexpectedly this link between BCS and molecular 
CO ' properties would provide a signature of the presence of the BCS phase just by looking at the molecular spectroscopic 
OO \ properties, which could be easier to observe experimentally than the BCS phase itself. 

1^ ' Actually we have quite recently considered the effect of the Fermi sea on the molecular bound state associated 
•"■"^ \ with a Feshbach resonance, when this is the only instability. We note that, since the Fermi sea is responsible for 
the formation of Cooper pairs, which are some kind of molecules, it is somewhat natural that it does also affect the 
molecular properties. We have shown that the presence of the Fermi sea shifts the location of the appearance of the 
"j--; : molecular state toward positive values for the scattering length [6]. This can physically be easily understood because, 
if we think of the wavefunction of the (large) molecule as made up from plane waves (this corresponds merely to the 
^ , Fourier expansion of the wavefunction) , the presence of the Fermi sea prohibits the occupation of a number of these 
I ' plane wave states because of Pauli exclusion. So the qualitative effect of this Pauli exclusion is to make the building 
' O \ of the molecular state more difficult than in vacuum. Naturally this exclusion effect decreases as T increases since the 
statistical occupation of states gets lower. As a result the molecule does not appear right at the Feshbach resonance 
as it occurs in vacuum. Instead the inverse scattering length has to be larger than a positive threshold in order 
to have an existing molecular bound state. To be complete we have to stress that the above picture is for molecules 
with zero momentum for the center of mass. When the molecule has a nonzero total momentum, the adverse effect 
of the Fermi sea will be smaller since Pauli exclusion will act on less of the plane wave states forming the molecular 
\2\ ' wavefunction. And it is clear that for a fast molecule (with respect to atomic gas velocities) there will be essentially 
no effect of the Fermi sea on the formation of the molecular bound state. We note that this shift of the threshold for 
appearance of the molecular states is in qualitative agreement with experimental observations of strong losses in ^Li 
appearing much below the location of the Feshbach resonance [7] . However the interpretation of these experiments is 
obviously complex, with in particular dynamical effects, and it remains to be seen how strong is experimentally the 
role of the effect that we have just described. The best tool is likely to involve some form of spectroscopy. 

Here we will use, as in the above study, the result obtained recently [8] for the scattering amplitude due to a 
Feshbach resonance, modified by the presence of the dense Fermi gas. Although obtained within a quite general 
formalism, this result makes use of strong simplifications. Nevertheless it is clearly worth exploring simple physical 
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approximations before going to more elaborate schemes. First the irreducible vertex is taken merely as the simple 
scattering amplitude of two isolated atoms. Second only Pauli exclusion is taken into account for the effect of the 
Fermi gas. Nevertheless the resulting scattering amplitude is quite non trivial. In particular, in contrast with the 
vacuum case, it depends on the total momentum of the scattering atoms because of Pauli exclusion. As already 
mentionned this effect is quite small for two atoms with very high momenta, and we will concentrate here on the 
case where the total momentum is zero since it displays the strongest manifestation of Pauli exclusion. Also any 
background scattering is omitted for simplicity 

The expression [8] for the full vertex r(a;) in the particle-particle channel, which, except for a factor 7r/2fco, is just 
the inverse of the effective scattering amplitude, is given by (we take h = 1): 



We have taken the chemical potential /i (assumed to be positive) as our energy scale and our wavevcctor scale fco is 
defined by /it = A;q/2to (it reduces to the Fermi wavevector at T = 0). We have introduced the reduced wavevector 
X = k/ko, the reduced energy to = ui/^ and the reduced temperature t = T/^. In contrast with Ref. [8], the origin for 
the energy cu of the two atoms has not been shifted at the chemical potential, but merely taken as usual at the bottom 
of the continuous energy spectrum for free particles. The coupling constant A is related to the scattering length a by 
A — ~2koa/Tr. We have introduced the reduced width of the Feshbach resonance W =- m^|wp/7r^fco where w is the 
matrix element [8] corresponding to the Feshbach coupling between the open and the closed channel. In the strongly 
explored case of ®Li , W is quite large and in Eq.(l) we will neglect QjW in the following. 

As it is well known the appearanc;c of the molecular bound state will show up as a pole in the vertex, and therefore 
it will be found by writing that the r.h.s. of Eq.(l) is zero. We note that the BCS instability itself appears also as 
such a pole. The imaginary part of Eq.(l) is zero at the chemical potential w = 2/1 and writing that the real part is 
zero leads to: 



which is just the standard BCS equation with our notations (notice that — 1/A is changed into — l/A-|-2/W^ if we take 

the W term into account). 

It is easily seen from Eq.(2) that the BCS transition is also found in the region a > 0, that is beyond the location 
of the Feshbach resonance in vacuum. This situation has already been considered by Milstein et al. [9] and by Ohashi 
and Grifhn [10] within a phenomenological fermion-boson model, and it is actually a clear ingredient of the BCS-BEC 
crossover. It seems at first surprising to sec BCS pairing for a > since in this case one has an effective repulsion 
between atoms. But one has rather to consider that the tendency to form a bound state is an increasing function of 
(taken algebraically), so that going to a > makes it even easier to form BCS pairs. On the other hand BCS pairing 
occurs in the Fermi sea : the BCS pole appears for a positive energy = 2/i > 0. Hence the BCS transition stops 
when fj, = 0. Leggett [11] has already pointed out that, for the excitation spectrum at T = 0, there is a qualitative 
change when one crosses fi = 0. In our case we are in the normal state and, at the level of our approximation, the 
chemical potential is merely related to the one-species atom number n by the free particle relation: 



Instead of n, we introduce for convenience the Fermi wavevector defined hy n = kp /Gtt^ and the corresponding energy 
Ep = kp/2m. From Eq.(2) and Eq.(3) we find the critical temperature Tc as a function of the scattering length a. In 
Fig. 1 we plot Tc/Ep as a function of 1/kpa. The end point (Tq, Uq) is found at Tq/Ef — 0.99 and l/kpao — 0.68. 

When is increased beyond this point we expect to find an instability corresponding physically to a molecular 
bound state. Naturally this is what happens but there is a qualitative change in this case. Indeed these molecular 
states correspond to negative values of the energy u), for which the r.h.s. of Eq.(l) is always real so we are no longer 
forced to require that its imaginary part is zero. Hence we do not need to take a specific energy, and for a fixed 
temperature T, we expect to find the binding energy |u;| increasing with a~^, just as it is in the absence of the Fermi 
sea. Actually this is the case that we have explored recently [6] for /i < 0, which means T > Tq. As already indicated 
we have found that, due to the presence of the Fermi sea, the molecular state with zero binding energy does not form 
for = as in vacuum, but rather for a positive value of o~^(T) which increases when T decreases. Naturally 
when for fixed T we increase beyond a^(T), the molecular binding energy increases from zero. Conversely we 
can say that, starting from large and positive values of and decreasing it, molecules start to dissociate at a^{T). 
We have plotted l/kpamiT) in Fig. 1 and we see that it meets the above curve for the BCS transition at the end 
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point. This is natural since this point corresponds to cancel the r.h.s. of Eq.(l) for lu = and /i = 0, so it belongs to 
the two curves. Hence there is a clear link between the molecular shift and the existence of the BCS phase. 
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FIG. 1. Critical temperature Tc of the BCS transition as a function of the inverse scattering length a^^, threshold a^{T) 
for formation of zero momentum molecules (curve labelled m), thresholds a~^(T) (labelled ml) and a^^C^) (labelled m2) 
(see text). Insert: trajectory of the BCS pole in the upper complex ui plane for T = (full curve) and for t = 0.2, 0.5, 1., 2. 
(successive dashed curves). The arrows indicate how the pole(s) moves when is increasing. 

It is now interesting to study in the same way what happens when we increase at fixed T for ^ > 0, that 
is r < Tq. More specifically we will follow the pole of T(lu) which gives rise to instability. When, for fixed T, we 
start from large and negative there is no instability, until by increasing (algebraically) we reach the BCS 
instability when we touch the Tc{a~^) curve. As it is well known this means that the corresponding pole, which was 
in the lower iv complex plane has moved up and has reached the real iv axis. This is easily checked on Eq.(l). More 
generally, since is real, we find the trajectory of the pole by writing that the imaginary part in Eq.(l) is zero, 
that is ImJ((D) = (if the W term is neglected). The result for this trajectory in the u complex plane is shown in the 
insert of Fig.l for various temperatures. 

We see naturally that, after crossing the real axis, the pole goes deep into the upper complex plane, corresponding 
to the fact that, when we enter more into the BCS phase domain, the normal state becomes more and more unstable. 
However when is further increased, the pole goes back toward the real w axis, eventually reaching it on the 
semi-axis uj < 0. This happens for a positive value a~\(T) shown in Fig. 1. At this stage the normal state has no 
longer, strictly speaking, a BCS type instability. It is rather a molecular type instability, characterized by a pole on 
the negative energy axis. However what happens next to the pole is rather surprising. When a^^ is increased beyond 
a~^(T), the pole splits into two poles, one with increasing uj, the other one with decreasing w. This is most easily 
seen at T = 0. In this case the integration in Eq.(l) is easily performed and one finds for the position of the pole on 
the negative ui axis: 

1 TT _i TT „ , 

— — = — — a = 2r arctanr — — r + 2 (4) 

A zkp 2 

where we have set r = (|a;|/2)^/^. Starting from 2 at r = 0, the r.h.s. of Eq.(4) first decreases, reaches a minimum 
—1/Xmin = 1-67 for u) = —0.39 (r = 0.30), then increases and behaves asymptotically as (7r/2)r. The minimum gives 
the value of a^j\(T = 0) for which the BCS pole reaches the negative uj axis at a) = —0.39. When ar^ is increased 
beyond a^\{0), one finds two solutions for Co around the minimum. One of them decreases, in agreement with the 
expected increase of a molecular binding energy. But surprisingly the other one increases and goes rapidly to a; = 0, 
where it disappears (more precisely it goes in the lower complex plane along the negative lu axis, where it has no direct 
physical manifestation). This disappearance occurs for — 1/A — 2. We call a^2i'^ = 0) = Akp/T^ the corresponding 
value of a^^. The lower pole is then at w = —2. Beyond 0^2(0) there is only one solution, corresponding to the 
continuation of the lower energy solution. Hence we recover the standard molecular situation of a single pole with a 
binding energy increasing with . 

In order to understand physically this strange situation it is worthwhile to note that, in the absence of a Fermi 
sea, the r.h.s. of Eq.(4) would merely be (7r/2)r, leading to the usual result \uj\ = 1/ma? for the molecular binding 
energy. Hence the Fermi sea contribution is 2r arctanr — 7rr + 2 = 2 J^dxx^/{x^ + r^). Therefore the non analytic 
decrease of the r.h.s. of Eq.(4), behaving as 2 — 7r(|a;|/8)^/^ near a) = 0, is produced by the presence of the Fermi 
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sea, and this is this decrease which creates the minimum and is responsible for the existence of the two poles. This is 
specifically produced by the — 7rr term. Now this term is easily linked to the density of states for positive energy, which 
is proportional to w^/^. Indeed if we evaluate the above integral for small and positive lo (with infinitesimal positive 
imaginary part), we find 2i?ln[(l — i?)/(H-i?)] +i7ri? + 2 with i? = (tI;/2)^/^, and the r.h.s. ofEq.(4) is obtained from 
the analytical continuation of this last result through the upper complex plane toward the negative uj axis. Actually 
all the information about this Fermi sea contribution is contained in the imaginary part ittR (essentially the density 
of states) since the real part can be recovered through Kramers-Kronig relations. Now we note that, for small w, this 
imaginary part is positive in contrast with the result Im7(a)) = —i{n/2)R for free particles. This gives [8] for the 
overall result Im/((D) = «(7r/2)_R. 

Clearly the physical interpretation of this change of sign is that, below the Fermi energy, we deal with hole-like 
excitations while above the Fermi energy we have the standard particle-like excitations: in order to create excited 
states below the Fermi energy we have to remove particles since Pauli exclusion forbids to add them. This leads to the 
conclusion that the bound state with very small binding energy we have found above, just detached from the Fermi 
sea, has a hole-like character. In other words it corresponds to a molecular state formed by two atomic holes (absence 
of atoms) rather than to a standard molecule formed by two atoms. It is a kind of antimolccule. We can come to 
this conclusion more rapidly by thinking of the situation we would have for a Fermi energy going to infinity. All the 
low energy states we could consider other than the ground state would be hole-like, since the only thing which could 
be done would be to remove particles. In particular we would have only hole-like molecules. Naturally we interpret 
the lower energy pole as a standard particle-like molecular state, since in particular it will be the only one present 
for a^^ > a^2i^)- C)n the other hand, if we think of decreasing a^^ below 0^2(0)1 we will have two poles, one being 
particle- like and the other one hole- like. Therefore when they merge at a~\ (0) the corresponding pole has necessarily 
a mixed particle-hole nature. But this is rather natural since this pole is a BCS-type pole as we have seen. Indeed it 
is well known that the BCS instability has this mixed nature (we can think of it as the formation of pairs of particles, 
or as well as pairs of holes), as it is reflected in the nature of the low energy single particle excitations in BCS theory. 
Hence it is rather natural that when the BCS pole, after moving in the upper complex plane, reaches the negative u) 
axis, it has still this mixed nature. This makes also likely that, when the two poles separate, they have actually also 
a mixed nature, with a full particle or hole character only reached at a~ 2 • 

The experimental observability of such a hole-like molecule is unclear. Indeed a hole around zero energy is quite 
deep below the Fermi energy and corresponds to a high energy excited state. It is likely that the lifetime of such 
a state will be quite short due to particle-hole recombination processes. These would appear because of the strong 
interactions of the atoms in Fermi sea, but they are not present in our approximate treatment since we evaluate /(cD) 
without taking into account these interactions. We would have to go beyond this theoretical level to make these 
processes appear. Similarly it is likely that the molecular states with partial hole-like nature will have a too short 
lifetime to be directly observed. Hence the physical situation for < < a~2 is quite unclear and it is not 
obvious how this domain will survive in improved theories. In particular the existence of two poles may suggest a 
more complex instability, or a forbidden domain with phase separation. On the other hand for > a^j2 
back to a simple physical situation. We have just a single pole corresponding to the formation of standard molecular 
state. However the remarkable point is that the binding energy \lD\ is always larger than 2 (i.e. \uj\ > 2Ef). This 
means that it is impossible to observe a molecular state with zero binding energy, in contrast to the classical case of 
a dilute gas for which the binding energy is zero at the Feshbach resonance = 0. Even if we believe it is possible 
to observe short lived molecules in the range < < a~2) this result remains valid as we have seen above. The 
lower bound for the molecular binding energy will just be smaller. Finally we have for simplicity limited our explicit 
quantitative study to the T = case, but it is clear from the insert of Fig. 1 that the same results will be qualitatively 
valid for all the range < T < Tq. The lower bound for the molecular binding energy will decrease with increasing T 
and go to zero for T = Tq. Since To is also the maximum temperature for the existence of the BCS phase, we reach 
the surprising conclusion that, whenever the BCS phase is present, we can not observe a molecule with zero binding 
energy. This offers an indirect way to demonstrate the presence of the BCS condensation. 

We have naturally to be quite specific with respect to the above statement. In this paper we have only studied 
the instabilities arising in a normal Fermi gas, with in particular no molecules already present. Therefore when we 
consider this gas for > a~ 2(^^)1 we deal with an out of equilibrium situation since at equilibrium a sizeable 
fraction of the gas should be under molecular form. Therefore we have in mind an experiment where, starting from 
the < side of the Feshbach resonance, one would very rapidly change a^^ by acting on the magnetic field and 
then observe the binding energy of the first few molecules appearing in the gas. We could also worry about the effect 
of the Bose-Einstein condensation of molecules. However in our simple picture the critical temperature for this BEC 
is [9] Tbec = 0.218Tf, so the effect we have considered could be at least observed in the range Tbec <T <Tq. Also 
the instabilities we have considered are all at zero wavcvector, just as the dominant BCS instability itself. So the 
molecules we considered have zero total momentum. For nonzero momentum the effects will be weaker, and we expect 
them to disappear at some wavector, whose inverse is of order of the Cooper pair size, just as the BCS instability 
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itself. 

Finally we have naturally to consider that our theoretical approach is clearly not quantitatively accurate, since 
for example our value for the BCS critical temperature Tc is just the standard one [12], and does not contain lower 
order fluctuation effects [13] nor higher orders and self-energy effects [14]. However we believe that our results remain 
qualitatively valid under much more general conditions. Indeed we see from Fig. 1 that the nonzero threshold for 
molecular binding energy that we have found is ultimately linked to the trajectory of the BCS pole in the upper 
complex plane. But the existence of a BCS pole, and its trajectory in the upper complex plane are quite general 
features of any theoretical description. Since we naturally expect to find molecules for very large a^^, this pole has 
to go back to the real negative lo axis, as we have found, which implies again the nonzero molecular binding energy 
whenever the BCS phase is present. In other words the (qualitative) topology of our results should remain valid even 
if they are quantitatively modified. 

We stress again that what we have done in this paper is to look at the instability properties of the normal state, 
even in regions where it is not the equilibrium state. We have found that, when goes from —oo to -\-oo across the 
phase diagram, these properties do not change smoothly, but rather that the behaviour changes on some lines that 
we have identified. One can wonder if the same is not true for the equilibrium phase, and in particular for the ground 
state in the superfluid domain for which a quite natural interpolating hypothesis [11,15] is a BCS-like ground state 
whatever the scattering length, since this wavefunction is known to describe properly the dilute molecular ground 
state [16] as well as the weak coupling BCS state. In this case one would rather expect a single instability to appear 
corresponding to the pair formation, so it might be that this BEC-BCS crossover is not as smooth as suggested by this 
picture, and that the actual physics is more complex. However our results have no direct bearing on this question, 
since we have explored only the normal phase, not the superfluid. We just note that, in the superfluid state, the effect 
of Pauli exclusion will still be present. 
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